Goto

Collaborating Authors

 combining dask and pytorch


Combining Dask and PyTorch for Better, Faster Transfer Learning - Saturn Cloud

#artificialintelligence

If you are still having any trouble understanding the process, it may help to think of all our workers as individuals working on the same puzzle problem. At the end of the epoch, they all hand their findings back to the master node, which combines the partial solutions each one has submitted. Then everyone gets a copy of this combined solution, which is still not complete, and they start working on it again for another epoch. The difference is that now they have a head start thanks to everyone's combined work.